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Material web surface roughness chocking e.g. for leather or foam • 
performing Fourier transformation of measured light reflection 
intensity values to determine local frequency spectrum components 
corresponding to roughness and comparing with desired roughness 

TZN FORSCHUNGS & ENTWICKLUNGSZENTRUM 92.09.09 

92DE-4230068 

(94.03.10) G01B 11/30. GOU 3/28, G01N 21/55. 21/89, 33/34 
The monitor system uses an optical reflection meter, the measured 
local Intensity values being converted into a frequency spectrum by 
Fourier transformation. The spectral components of the obtained 
spectrum are analysed to determine the surface roughness and 
compared with characteristic values corresponding to the required 
surface roughness. 

The surface of the web (1) is illuminated by a light beam (7) 
directed onto it at an angle, with detection of the reflected light 
normal to the \ -b surface via a photo sensor (4) coupled to an 
evaluation device (5) incorporating a microprocessor (15). 

USE /ADVANTAGE - For checking grain depth of real or 
artificial, leather, controlling pore size of foam material or emery or 
abrasive paper. Generates reproducible measurement values for 
different types of materials. (5pp Dwg.No.1/2) 
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94-008875/02 D18 DURK 92JW.18 

DUERKOPP SYSTEMTECHNIK GAABH *DE 4231222-Cl 

92.09.18 92DE-4231222 (94.0). 13) G01N 33/44, G01AA 11/08, 
G01N 21/88 

Leother foult marking - has balls in quality zones with structured 
flats 

C94-003586 

Addnl. Data: D AMMER-T REDE W, NIEMANN J, BRUDER W 



To mark fault zones in natural leather, a number of balls 
(Ku) with flat zones are placed at different quality zones. 
The flattening of the balls (Ku) has a selected radius (r) so 
that the projection surface and the smallest possible viewing 
angle (alpha) always form a circle with the radius (r). 

USE/ ADVANTAGE 

The system is for marking different quality zones on the 
surface of natural leather, to show different fault degs., 
which can be identified by a camera without misinterpretation, 

PREFERRED EMBODIMENT 



The camera (Ka) is at a vertical gap (b) from the laying 
surface (E) and at a horizontal gap (a) to the ball (Kulin 



view. The viewing angle (alpha) is set by tan alpha =- 
and alpha = flrntnn - . The stretch fxl from the ball 



centre to the standing surface Is x = sine beta where beta 



D(7-A) 



90 deg. - alpha, and sine beta = cosine alpha. The max. 
permissable height (h) of the flat is computed as h = r-x 
and h = r(l-sine beta) = r(l-cosine alpha). The stretch 
(h) must always be shorter than the theoretical value, to 
allow for corrugations. (5pp249JHDwgNo2/2). 
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9V-168330/15 D18 COUS/ 97.08.29 
COUSARD R *DE 19737703-AI 
97 08.29 97DE- 1037703 (99.03.04) G0IN2J/88, CI4B 1P6, G01M 
11/00. G01N 21/25 
Classification of hides and skins into grades during processing 

C99-049389 
Addnl. Data: COUSARD R 


D(7-A) ^0 


The method classifies bides into grades according to future use. 
These correspond with e.g. shoe making, furniture cove ring and other 
applications. The general color is also registered, and is important in 
e.g. covering a light suite. An objective, standardized data recording is 
made, which cannot be forgotten. Time-consuming manual methods 
are avoided, increasing productivity and accuracy. Large hides, up to 
1 1 m 2 , are registered effortlessly. Integration of the method into the 
conventional industrial process, is discussed in greater detail in the 
disclosure. 

DESCRIPTION OF DRAWING 


NOVELTY 

The hide is spread out flat and illuminated by light of differing 
colors, from different directions. A photometric camera (9) records the 
results. 1 ne optical image oata is aigiuzeu, evajuaieo uiiu lomparcu 
with set test criteria. Defects are presented. 

DETAILED DESCRIPTION 


The drawing is a sectioned elevation of the test section. 
Photometric camera 9 
Spreading and tensioning unit 2, 3, 4 
Red, green and blue lights 5 
Light shade 7 

TECHNOLOGY FOCUS 

Mechanical Engineering - During recording, red, yreen and blue light 

|DE 19737703-A+ 


An INDEPENDENT CLAIM is included for the equipment for 
the above process required, comprising a spreading and tensioning 
unit (2, 3, 4) for the hide. 

USE 

To evaluate the defects and appearance of hides at the tannery. 
ADVANTAGE 



(5) are used. The camera continuously registers the hide, remaining 
stationary as the hide is moved through the test section below. The 
hide is tensioned during recording. In recording and/or displaying 
results, image filtration is used. Before starting, lest parameters and 
criteria are determined. The tensioning device includes two roller pairs 
(2, 3, 4), through which the hide is passed, one pair running slightly 
faster than the other. The illumination is shaded (7). Wavelength and 
intensity of illumination are adjustable. Several color cameras may be 
used. 
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(54) Title: VISUAL INSPECTION SYSTEM FOR LEATHER HIDE 
(57) Abstract 

A visual inspection system particularly designed for imaging 
relatively non-rigid materials, in order to identify defects and the 
position of defects on the material. The arrangement is particularly 
designed for handling leather hide. Defects in leather hide are 
presently identified by manual inspection. The present invention 
provides a visual inspection system for non-rigid materials (2), 
comprising a mounting means (1) for mounting a sample of the 
material, tensioning means (4) for tensioning at least an area of the 
sample, an imaging means (3) for obtaining an image of the area of 
the sample under tension and processing means (17) for processing 
the image to provide information on any defects which may exist. 
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VISUAL INSPECTION SYSTEM FOR LEATHER HIDE 

The present invention relates generally to a visual 
inspection system and, particularly, but not exclusively, 
to a visual inspection system for inspecting leather 
hides . 

The effect of damage caused to the hide of an animal 
during its lifetime is a major problem for the tanning 
industry. Such damage may result in defects existing in 
the processed leather hide, in the form of scars, 
abrasions and the like. The nature and quantity of 
defects existing in any particular hide will effect its 
application in the manufacture of leather goods. Areas 
of hide containing defects may be considered unusable, or 
useful only for particular purposes. 

It is necessary to visually inspect each hide to 
determine the nature and distribution of defects, in 
order to "rank" the hide in terms of quality and sale 
price. Further, in the initial stages of manufacture of 
leather goods it is also necessary to inspect a hide to 
determine the location of non-defective areas which can 
be used in manufacture. For example, in the manufacture 
of shoes, shoe components of different sizes and shapes 
are "nested" within the hide geometry and cut manually 
using dies and a swing beam press. In the nesting and 
cutting operations, the operator must avoid defects. 

Visual inspection of the hide, both for ranking and 
nesting/cutting, is presently carried out manually by 
skilled operators. 

In the ranking process, an assessment is made of the 
degree to which the existent damage will effect the 
cutting yield, and the hide is priced accordingly. This 
assessment is of necessity subjective, based on the 
operators' skill and experience. A subjective analysis 
can lead tc non-uniformity in ranking between respective 
operators, and has resulted in disputes between tanners, 
pricing the hide, and leather goods manufacturers, 
purchasing the hide. In Australia, rates of return of 
hides from leather goods manufacturers to tanners as a 
result of disputes over ranking of hides run as high as 
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15% and result in disruption in production schedules and 
costs to both the manufacturer and tanner. 

In the nesting/cutting process, a skilled operator 
attempts to achieve both optimum layout of patterns for 
components of leather goods and avoid defects unsuited 
for manufacture of the particular leather goods. This is 
an almost impossible task. Wastage of 34% on average of 
raw material is common, in Australia. Further, under 
current manual cutting methods, the variation in yield 
between operators is in the order of 10%, depending upon 
the skill of the particular operator. 

An automated visual inspection process, which may 
provide a more objective approach, may save operator 
costs and provide for more efficient utilisation of 
material, is therefore desirable. Development: cf an 
automated system presents a number of problems, however. 

Leather hide and like materials are non-rigid or 
"floppy". Any imaging device would have difficulty 
obtaining an accurate image of defects and distinguishing 
from shadows cast by raised or lowered areas of the hide 
caused by the "f loppiness" . Further, certain types of 
defects in animal hide may be invisible unless the hide 
is deformed before viewing. Such defects include scars 
which have become "sealed" because they healed in the 
animals' lifetime. Present examination for sealed scars 
involves the operator stretching the hide over his finger 
to make the sealed scars more visible. This presents a 
significant hide manipulation problem for any proposed 
automatic process. 

Difficulties also lie in processing an image from an 
imaging device to distinguish between defective and non- 
defective areas of a hide. 

The present invention provides a visual inspection 
system for non-rigid materials, comprising a mounting 
means for mounting a sample of the material, tensioning 
means for tensioning at least an area of the sample, an 
imaging means for obtaining an image of the area of the 
sample under tension and processing means for processing 
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the image to provide information on any defects which may 
exist . 

The system is preferably arranged for inspection of 
leather hide, although it is possible that the invention 
could be applied for inspection of other materials, 
particularly, but not exclusively, non-rigid or "floppy" 
materials . 

Tension is applied to the material so as to reveal 
any "hidden defects". Where the material is leather 
hide, enough tension should be applied to make any sealed 
scars sufficiently visible to enable detection by the 
imaging device. Preferably, the hide is tensioned over a 
former. In one embodiment the former is a relatively 
small diameter roller. In an alternative embodiment the 
former has a substantially flat surface. 

Tension is preferably applied to the hide in such a 
direction as to promote visibility of the majority of 
hidden defects existing in the hide. To facilitate this, 
the hide is preferably fed over the former during the 
imaging process in a direction perpendicular to the 
direction cf the backbone of the animal in its lifetime. 
It is considered the majority of scars likely to have 
been obtained by the animal in its lifetime will run in 
substantially the same direction as the backbone (i.e. in 
the direction the animal walked when alive) . 

.In a preferred embodiment, tension is applied in at 
least two directions, one direction being substantially 
at right angles to the other direction. This maximises 
the opportunity for opening and revealing all defects in 
the hide . 

In a preferred embodiment, this dual tensioning is 
facilitated by a former which comprises a plurality of 
substantially flat areas for supporting areas of the hide 
sample to be imaged, separated by depressions. The hide 
is tensioned in a first direction perpendicular to the 
extending direction of the former over the substantially 
flat portions, and is tensicmed in a second direction, 
which is in the same direction as the extending direction 
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of the former, by pressing portions of the hide into the 
depressed portions, applying tension to the portions of 
the hide extending over the flat portions. 

A light source is preferably provided to illuminate 
the area of the hide being imaged. The relative 

positions of the light source, hide and imaging device 
are preferably such that the imaging device perceives 
defect areas as having lower and higher "grey level " 
(i.e. being darker or lighter) than non-defect areas. 
This may be because defect areas are cast into shadow 
and/or cause bright reflecting edges because of the 
relative positions of the light source, camera and hide. 
The light source preferably provides a strip of light 
focused onto the area of the hide being imaged and the 
imaging device is preferably a charge coupled device 
having a single line of pixels focused on the area 
illuminated by the strip. The entire hide is preferably 
passed over the former through the imaging area, so that 
its entire area is scanned line by line. 

On a typical open scar, the edges will appear 
brighter than the surrounding surface, whilst the centre 
of the open scar will be darker due to shadow. Sealed 
scars are visible because of their discolouration. 

The intensity of the light source is preferably 
variable, so it may be adjusted to provide the best 
results for different coloured hides. It has been found 
that, generally, the darker the hide, the higher 
intensity required for the light. Further, the higher 
the speed of the hide being passed over the former as it 
is being imaged, i.e. the higher the scanning speed of 
the imaging area, the higher the intensity required for 
the light source. Although variable intensities are 
preferably provided by the light source, at any one 
intensity the light distribution over the width of the 
scar. should preferably be as uniform as possible. 
Variations in uniformity of the light source for any one 
image will increase the difficultly in processing the 
image to detect defects. Light sources may include a 
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fibre optic array or a mirror tube. 

The entire image detected by the camera is 
preferably not stored in memory and subsequently 
processed. This would take too much time. Instead, the 
picture is preferably analysed on-line in real time as it 
is received, preferably to give a contour map showing the 
boundary areas of any defects together with associated 
information as to the character of the defects, and 
perimeter size of the hide. This "extracted information" 
is stored in memory. 

In one embodiment, in order to determine that a 
defect exists, a statistical analysis of grey levels 
received for each pixel by the imaging device is 
preferably applied. The median of grey levels is 

considered :o represent non-defective leather. A point: 
on the median statistical curve sufficiently below or 
above the median (i.e. sufficiently darker or lighter), is 
defined as defected leather, i.e. anything below or above 
these points is considered to be a defect. The number of 
pixels below or above this grey level which are adjacent 
to each other gives an indication of the extent of the 
area of the defect. Further, the lower or higher the 
grey level the greater the depth or height of the defect, 
i.e. the darker the shadow or brighter the reflection 
cast by the light source onto the image area. A normal 
distribution is preferably used for the statistical 
curve. Calibration runs with different types of leather 
are preferably carried out in order to assist in setting 
the grey level limits as to what is and what is not a 
defect .for that particular type and colour of leather. 
The leather may therefore be classified according to 
type/colour and different statistical analyses may be 
applied to different types of leather. 

Quantitative definitions of leather defects are 
preferably stored in memory and the processing means 
compares information determined for each defect with the 
stored definition to classify the particular defect. 
Definition is preferably in terms of area size and depth 
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of the defects. 

In a preferred embodiment, after a hide has been 
processed the results are stored in memory as a map 
indicating size and location of the defects on the hide 
5 as a contour, together with information relating to the 
nature of the defect in relation to its area size and 
depth as classified by comparison with the stored 
quantitative definitions, and information on the total 
area and perimeter of the hide. A number of maps may be 

10 stored for each hide, e.g. giving different maps showing 
different classes of defects. The map or maps may be 
stored on recordable media, which may be supplied to the 
leather product manufacturer with the hide, so that the 
manufacturer is provided with a complete set cf defect 

15 data to assist in subsequent processing. 

Further, the processing means preferably applies an 
assessment technique to "rank" each leather hide. The 
assessment technique comprises scanning a template with 
known size across the stored map to identify cuttable 

20 areas of the leather which will be useful in leather 
product manufacture. For example, for in the shoe 
industry, the "quarter" concept is preferably used. A 5 
x 12 cm mask is scanned across the stored map. 5 x 12 cm 
of undefected leather is the smallest amount cf 

25 undefected leather useful in shoe manufacture. The 
template is first scanned vertically across the entire 
area of the leather sample (i.e. in a series of adjacent 
vertical columns) , and then diagonally at 45° angles 
upwardly across the leather and downwardly across the 

30 leather (so that the two diagonals intersect each other 
at 90°), again scanning the entire surface in each 
direction. information obtained from the scans is 

processed to give a value for total cuttable area for 
each hide and total defect area. This information can be 

35 used to objectively rank and price the particular leather 
hide. The processing means may apply a similar ranking 
process automatically, by "scanning" the stored extracted 
image . 
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The present invention further provides a method of 
visually inspecting materials, comprising mounting a 
sample of the material, applying tension to at least an 
area of the material, obtaining an image of the area of 
5 material from an imaging device and processing the image 
to provide information on any defects which may exist in 
the material. 

Features and advantages of the present invention 
will become apparent from the following description of 
10 embodiments thereof, by way of example only, with 
reference to the accompanying drawings, in which; 

Figure 1A is a schematic side view of a visual 
inspection system in accordance with a first embodiment 
of the present invention ,- 
15 Figure IB is a plan view of the inspection area of 

the embodiment of Figure 1A; 

Figure 2 is a detail of a modification to the system 
of Figure 1; 

Figure 3 is a diagram of a statistical distribution, 
20 used in the processing method applied in this embodiment. 

Figure 4 is a table giving an example of 
quantitative definition of leather defects, as applied in 
the processing means of this embodiment; 

Figures 5A to G are example representations of raw 
25 and processed images of leather hide; 

• Figure 6 is a schematic diagram . illustrating a 
process of analysing an imaged hide in order to rank the 
hide; 

Figure 7 is a side view of a portion of a visual 
3 0 inspection system in accordance with a second embodiment 
of the present invention; 

Figure 8 is a schematic full side view of the second 
embodiment of the visual inspection system; 

Figure 9 is a partial section on line XX of figure 

35 7; 

Figure 10 is a partial section on line YY of figure 

7; 

Figure 10b is a partial section on line 2-2 of 
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figure 7; 

Figure 11 is a top view of a lateral tension bar 
element of the second embodiment; 

Figure 12A is a schematic view of a portion of the 
5 visual inspection system of the second embodiment, 
illustrating imaging and tensioning areas and a top 
support belt arrangement; 

Figure 12B is a further view of the portion of 
figure 12A f but this time illustrating the paths of 
10 bottom support belts; 

Figure 13 is a further partial top view of the 
second embodiment of the visual inspection system; and 

Figure 14 is a graphical representation of a "noisy 
edge" of a defect in a material sample, for illustrating 
15 an alternative method of identifying defects; 

Figure 15 is a graphical illustration of a point or 
pixel examination for determining the position of a 
defect ; 

Figure 16 is a graphical representation of an 

20 example defect "edge" for illustrating how a defect edge 
is determined; and 

Figures 17A through 17C are example processed images 
of a leather hide surface showing, in turn, an original 
raw image (A) , the image after edge detection has been 

25 applied in accordance with an embodiment of the present 
invention (B) and the image after an edge verification 
algorithm has been applied in accordance with an 
embodiment of the present invention (C) . 

Reference numeral 1 generally designates a handling 

3 0 means 1 for mounting and handling a sample of leather 
hide 2 (or other non-rigid material) so that it can be 
imaged by CCD line scanner 3. Handling means 1 comprises 
a former, in this embodiment being a 12 mm diameter 
roller 4 over which the hide 2 is tensioned (12 mm has 

35 beer. found to be optimum for this handling means 
arrangement to enable applied tension to increase 
detectability of any hidden defects in a hide, without 
over-stretching the hide. Other diameters may still be 
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useful, however) . The leather sample 2 is supported by a 
pair of conveyor belts 5 and 6 running in directions as 
indicated by the arrows on the diagram of Figure 1 . The 
pair of conveyor belts 5 and 6 operate to transport the 
hide 2 from left to right as shown in the drawings, over 
the roller 4. The sample hide 2 is unsupported by the 
conveyors 5, 6 as it passes over roller 4, as indicated 
in Figure 1. Conveyor 6 is arranged to run slightly 
faster than conveyor 5 in order to apply tension to the 
leather sample 2 as it passes over roller 4 . The 
conveyors are driven by torque controlled motors Mj , M2 
(Figure IB) . 

The tension applied should be sufficient to allow 
the camera 3 to detect any hidden defects, such as sealed 
scars, in the leather. The value of the tension applied 
will depend upon the thickness, type of leather and size 
of hide. Calibration should be made with different types 
and thicknesses of leather to assess the optimum tensions 
to be applied for each type/thickness. Tensions will 
generally be in the order of 100-500N. 

The handling means further comprises guide rollers 9 
and 10, opposing rollers 7 and 8, respectively; a safety 
guide 11; a feed roller 12 for feeding leather samples 
onto conveyors 5 and 6, and a take up roller 13 for 
taking up processed leather sample. Handling means 1 is 
of -sufficient dimension to process all leather hide 
sizes. In conventional tanneries, the guide roller 
should be in the order of one metre long in order to deal 
with leather hides of up to one metre in width. 

The colour of the former roller 4 should provide 
sufficient contrast with the colour of the particular 
hide sample to enable the system to be able to detect and 
identify the hide perimeter. To enable the system to be 
used with hides of different colour, a variation to the 
mounting arrangement, as shown in Figure 2, is employed. 
Four former rollers 4A through 4D, are mounted on a 
centrally extending spindle 15. The spindle 15 can be 
rotated to change the position of the respective rollers 
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4A through 4D. Only one roller at any one time will be 
used as the roller to mount the leather sample. Each 
roller is a different colour. The arrangement replaces 
the single roller 4 in Figure 1, and facilitates 
5 inspection of hides of various colour. 

A light source 16 is provided mounted on the 
opposite side of the roller 4 to the camera 3. The light 
source is set at an angle of 40° to the horizontal plane, 
and the camera is set at angle of 45° on the other side 

10 of the roller 4. Alternatively the light source may be 
set at 45° and the camera at 40°. It is preferred that 
there should be an angle of inclinitat ion between the 
light source and camera of 85° -95° and that either the 
light source or camera should be offset at an angle of 5° 

15 more than the other. The light source uses an acrylic 
lens system to provide a strip of light focused on the 
leather sample being tensioned over the roller 4. The 
light source may comprise a fibre optic array or mirror 
tube. The camera has a single line of charge coupled 

20 devices for receiving light reflected from the leather 
sample 2. With this arrangement, it has been found that 
defects in the leather appear darker or lighter because 
the strip light source 16 casts a shadow in the defect 
area or causes an area of greater reflection. The defect 

25 area is therefore darker or lighter, or a mixture of 
both, than "background", background being undefected 
leather. intensity of the light source 16 is 

controllable. It has been found that for darker leather 
samples, a higher intensity is required to achieve the 

30 besr results. Further, if the scanning speed is 

increased (i.e. the speed of the leather being passed 
over the roller 4) it is also required to increase the 
intensity cf the light source 16. Optimum incensity of 
the light source for different coloured samples of 

35 leather may be established by calibration runs with 
different types/colours of leather . 

The width of the imaging area may be from 0 . 1 mm 
upwards. In this embodiment the light strip is 5mm in 
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width. The length of the line is preferably in the order 
of 1,000 mm, although this can be varied to deal with 
requirements for different width of hide. In order to 
provide an imaging device capable of imaging a line of 
1,000 mm width, it may be necessary to use a number of 
adjacently mounted CCD devices 3. In the present 

embodiment, pixel size is preferably 0.4 mm 2 , and the 
camera/cameras are set up at an appropriate distance from 
the former roller 4 to provide this pixel size. 

The camera 3 scans the leather a line at a time as 
it is passed over the roller 4. The image received by 
the camera 3 is transmitted to the processing means 17, 
where it is analysed. 

Rather than storing the entire image for subseauent 
processing, the image is analysed in real time to extract 
relevant information and the relevant information is 
subsequently stored. This enables leather samples to be 
processed in reasonable time periods, in the order of 15 
seconds per sample, for example. 

The information required includes the following: 
1- The location and extent of any defects. 

2. The nature of the defects. 

3. The extent of the perimeter of the sample hide. 
Utilising this information, the processing means 

constructs a "map" of the leather sample illustrating the 
defects in contour. Each defect is classified in 

accordance with a quantitative definition of leather 
defects stored in the processing means 17, the 
quantitative definition being on the basis of depth and 
area of the defects. A contour outline of the perimeter 
is also included in the map. 

The camera 3 provides a "raw image" displaying a 
variation in grey level (i.e. variation in shade) across 
the image. The processing means 17 is arranged to make a 
determination as to which grey levels of the image 
indicate the existence of a defect. In this embodiment, 
a statistical analysis of the grey levels is applied. 

Because of the relative orientations of the light 
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source 16, sample 2 and camera 3, defects in the leather 
appear as shadows which are darker or areas which are 
lighter, or both, than the undefected leather. Areas 
containing defects will therefore be darker or lighter, 
5 or both, than areas having no defects. In analysing the 
image, it must be determined at what level of darkness or 
lightness a defect should be defined. 

The "background" of a sample, i.e. the undefected 
leather background, is expected to be substantially 

10 homogenous i.e, there should only be small variation in 
the grey levels exhibited. Unfortunately, large 

variations do occur because of a non- random effect of the 
light source. In order to cope with this problem, each 
image is divided into small square areas of equal size, 

15 or "cells". In the preferred embodiment, each cell 
comprises 10 4 pixels. It was found that each small area 
or cell could be regarded as approximately homogenous 
with respect to the effect of the operating conditions. 
This approach can be considered analogous to noise 

20 reduction through blocking in statistical experimental 
design . 

The processing means is arranged to analyse each 
cell of the image separately and then build up the image 
cell by cell to provide a map containing the relevant 

2 5 information. 

-The median grey level of each cell is defined as the 
"background". Using a normal distribution, levels of the 
extreme of the distribution are defined by the processing 
means 17 as defects. In this embodiment, all the defects 

3 0 will be at the low, or//and high ends of the normal 

distribution, i.e. at low or high grey levels. Figure 3 
shows a normal distribution based around the median level 
of grey level. The left hand side of the curve contains 
grey levels which are darker than the right hand side. 
35 All pixels having a grey level below threshold .20 on the 
normal distribution curve are considered to belong to a 
defect. The threshold is selected by pre -calibrating the 
system for various different types and colours of leather 
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and using standard statistical techniques. Different 
thresholds are provided to define different degrees of 
defect. An A defect is the least serious defect, 
progressing further down the curve, B defects and then C 
and D defects are also defined. C and D defects are the 
most serious defects. A similar calibration is provided 
for the extreme right hand side of the normal 
distribution, for defect areas which appear at higher 
grey levels because of higher reflectivity. 

Using this type of statistical analysis, the 
processing means is able to build up, cell by cell, a map 
of the sample illustrating the location and extent of 
defects in contour. It is also able to classify the 
defects according to seriousness. 

The grey level of the dark area is an indication of 
its depth (for open scars) , because the light source 
casts a shadow in the area of the defect. The darker the 
shadow, it is assumed the greater the depth of the 
defect. A quantitative definition of defects can 

therefore be made, on the basis of depth and extent of 
area. Figure 4 gives an example of a table showing the 
quantitative definition which has been established for 
this particular system. N indicates no defect. A, B 
and D indicate defects of increasing seriousness . Depth 
can be correlated with darkness of the pixels, using the 
normal distribution as discussed above. The defects are 
then further classified depending upon the area of extent 
of the particular defect. 

Brackets around a defect classification indicate 
that it is a sealed defect. 

It will be appreciated that other classifications 
may be employed to define defects, in alternative 
embodiments. It will obviously be advantageous for the 
industry ~o decide upon an objective classification of 
defects for uniform application of the system in 
accordance with the present invention. 

The processing means 17 may produce a series of 
maps, as illustrated in Figure 5. 




WO 97/29368 PCT/AU97/00067 

- 14 - 

Figure 5A shows the raw image as detected by the CCD 
camera 3. This is not stored. Instead, it is processed 
cell by cell, employing the processing technique 
discussed above. 
5 Figure SB shows the raw image after feature 

extraction. Defects show up as white areas. Again, this 
image is not stored. 

Figure 5C shows a map of all defects extracted from 
the raw image. This image can be stored in memory. 
10 Figures 5D through 3F show B , C and D defects, 

respectively . 

Figure 5G is a contour map of all the defects. 
Defects are first classified and maps provided of 
their location and extent. This information can be 
15 recorded on disk and provided to a leather goods 
manufacturer for use in processing the particular leather 
hide . 

Further analysis of the stored maps is carried out 
by the processing means 17 in order to provide 

20 information useful for ranking the leather. 

Conventionally, the "quarter" method is used to rank 
leather. A template, for shoe products being 5 x 12 cm 
in area, is used to determine exactly what portions and 
how much of the total area of the particular leather 

25 sample can be used for shoe products. The template is 
matched with each portion of the leather. Any portion of 
leather including a defect falling within the template 
may not be useful. Figure 6 shows a template 25 adjacent 
to a serious individual defect 28 and other defect 2S. 

30 The area 26 is unlikely to be useful as wherever the 
template is placed within that area it will impinge upon 
a defect. 

The processing means 17 further processes a stored 
contour map of a particular leather sample by passing a 
35 computer generated "template" across the map to determine 
cuttable areas of the leather sample. The template is 
first passed in parallel vertical passes across the 
entire surface of the map and then in parallel diagonal 
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passes across the entire surface of the map 45° to the 
vertical and then further diagonal passes across the map 
at 135° from the vertical (i.e. two diagonal lines which 
intersect each other at 90°) . The diagonal passes may be 
made in the range + 45°. Information on the total 
cuttable area is provided and also on the absolute area 
of the defects of any particular leather sample. This 
information can also be provided to the leather 
manufacturer . 

The leather processor is thus provided with detailed 
information following an objective analysis of a 
particular leather sample to determine its usefulness in 
manufacturing leather products. Further, an objective 
ranking and pricing of any particular leather hide can be 
obtained using this system. 

In this particular embodiment, a Line Scan Dalsa 
Camera was used. The light source utilised a double 
acrylic lens to focus a strip of illumination on the 
sample. One fibre optic guided light source powered by a 
variable DC power supply was used as the illumination 
source. An IPX Sun SPARC Station Coupling with the 
Imaging Technology series 150-4 0 boards, together with a. 
Convolver-Arithmetic Logic Software Library was applied, 
to process image data. 

One problem of the visual inspection system 
embodiment of figures 1 and 2 is that in order to pass 
the material sample 2 over the former roller 2 and 
between the tensioning rollers 8 and 10 , some manual 
handling of the sample 2 is required. In a work place 
situation, this can be a safety hazard. The operator's 
hands could get caught in either set of rollers 8, 10 or 
7, 9 and cause serious injury. Another disadvantage is 
that the material sample 2 is unsupported between the 
former roller 4 and each of the sets of rollers 8, 10 and 
7, 9. This could result in "runaway" of the material 
sample i.e., the sample may be misfed in the wrong paths 
between the rollers. 

Yet a further problem with this embodiment is that 
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tensioning is applied in only a single direction, from 
left to right in figure 1 over the former roller 4 . 
Although defects and scars will be made more visible by 
the applied tension in that direction, defects and scars 
5 which run in other directions on the hide sample may not 
be made sufficiently visible for sufficiently accurate 
detection or examination. 

Figures 7 through 13 are various schematic views of 
a second embodiment of a visual inspection system in 
10 accordance with the present invention. 

Referring to figure 6, reference numeral 20 
designates generally a handling and processing system for 
non-rigid materials, such as leather hides. The 
arrangement comprises an operator panel 21, a monitor 22 
15 to enable images of the material to be viewed as the 
imaging process is ongoing and a processing means 23 for 
processing image information to identify defects, 
determine their position and make an examination of them 
so that they can be classified. 
20 The system further comprises an infeed conveyor belt 

24 driven by conveyor rollers 25 and 26 in the direction 
indicated by arrow 27. A non-rigid material sample 28 is 
passed along the conveyor 24 into a tensioning, support 
and imaging section 30. Tensioning, support and imaging 
25 section 30 is described in more detail later on with 
reference to some of the other figures. A cleaning 
roller 29 is provided and is positioned to contact the 
sample 28 prior to the samples entry to the tensioning, 
support and imaging section 30. A colour sensor 31 is 
30 positioned after the cleaning roller 29 to detect a 
colour of the sample 28. 

An outlay section 32 is provided for feeding the 
sample 2 8 from the tensioning, support and imaging 
section 30 into a bin 33, for subsequent collection. The 
35 outlay section 32 comprises a plurality of rollers, which 
extend width ways the same length as the rollers (to be 
described later) of the tensioning, support and imaging 
section 30. Imaging means, comprising CCD's 34a and 34b 
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are provided for imaging areas of the sample 28. Light 
sources 35a, 35b are provided for illuminating the areas 
to be imaged. 

The entire arrangement is supported by a frame 36. 
Drive motors, M3, M 4 , M 5 , M 6 are schematically illustrated 
in figure 13 for the tensioning, support and imaging 
section 30 rollers and for rotating the formers (see 
later) . The frame 36 comprises two side portions 36a, 
36b (see figure 13) only one of which is shown in figure 
8. The side portions 36a, 36b mount bearings for 
supporting the rollers of the arrangement. 

A more detailed description will now be given of the 
imaging means and the tensioning, support and imaging 
section 30, with reference in particular to figures 1 
through 13. 

The tensioning, support and imaging section 30 
comprises three sets of rollers. Set 1 comprises rollers 
4 0a and 4 0b. These are feeding rollers for feeding a 
sample 28 (not shown) into an imaging area. Rollers 4 0a 
and 40b support a pair of feed belts 41 and 42 which are 
moved in the directions indicated by the arrows A, B, C, 
D, following rotation of the rollers 40a and 40b as 
indicated by arrows E and F. Note that belt 41 is formed 
as an end portion of infeed conveyor 24. Belt 42, 
however, is not shown on figure 8, for the purposes of 
clarity. It will be appreciated that a further roller or 
mounting is required to support the end of the belt 42 
opposite from the roller 40b. This further mounting is 
not shown, again for purposes of clarity. Belt 41 may 
not be the same belt as belt 24, but may be a separate 
belt. 

In operation, the material sample is fed in at 43 
between the rollers 40a and 40b and between the belts 41 
and 42. As it is fed in, therefore, it is enclosed and 
supported by belts 41 and 42, which assist in keeping the 
material sample as flat as possible and avoids the need 
for an operator to feed the sample into the rollers 40a, 
40b. 
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Once through the feed rollers 40a, 40b, the material 
sample is passed over a first former or inspection roller 
44. While passing over the first former, the material 
sample is still maintained supported between upper and 
5 lower belt sets, which will be described in more detail 
later. Substantially flat upper surface portions 45 of 
the former 44 provide imaging areas for imaging of the 
material sample. A second set of rollers comprise 
tensioning rollers 46, 47. These rollers are arranged to 

10 be driven in the direction indicated by arrows G and K, 
and in operation the sample passes between them, entering 
at 48. As it passes between the rollers, the sample is 
maintained and supported between upper and lower belt 
sets, as will be described in detail later. Rollers 46 

15 and 47 are driven slightly faster than rollers 4Ca and 
40b in order to tension the sample as it passes over 
former 44, the tension being applied in the direction 
from left to right, perpendicular to a longitudinal axis 
49 of the former 44. As with the first embodiment above, 

20 the value of the tension applied will depend upon the 
thickness, type of leather and size of hide and 
calibration should be made with different types and 
thicknesses of leather to assess the optimum tensions to 
be applied for each type/thickness. Tensions will 

25 generally be in the order of 0.2 to 2.0 newtons/mm. 

A second former or inspection roller 50 is provided 
displaced from the first former 44, to the left of it in 
the drawing of figure 7. In operation, the material 
sample is also passed over this former, which includes a 

30 plurality of top surface portions 51 which are 
substantially flat and which provide further imaging 
areas for supporting the sample while it is imaged. As 
the sample is passed over the further former 50, it is 
supported between upper and lower belt sets, as will be 

35 described in more detail later. 

A third set of rollers 52, 53 is provided, to the 
left of the further former 50 in figure 7. In operation, 
the material sample is passed between the rollers 52, 53, 
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entering at S4 , as the rollers are driven to rotate in 
the directions indicated by arrows I, J. After passing 
between the rollers 52 and 53 the material sample is 
conveyed away from the tensioning, support and imaging 
section 30, by belts 55 and 56, which travel in the 
di rections indicated by K, L, M and N. Again, as the 
material is conveyed away from the tensioning, support 
and imaging section 30, it is fully supported between the 
belts 55 and 56. The material sample is thus fully 
supported over the entire length of its traverse into, 
through and away from the tensioning, support and imaging 
section, 30. No operator intervention is therefore 
necessary for feeding of the material through this area 
and danger to an operator is therefore minimised. 

Rollers 52 and 53 are arranged to be driven at an 
incremental speed greater than rollers 4 6 and 47, to thus 
apply tension to the material as it is passed over the 
further former 50, in a direction perpendicular to a 
longitudinal axis 56 of the further former 50. 

The arrangement of the belt sets for feeding the 
material through the tensioning, support and imaging 
section 30, will now be described with reference to the 
figures , and with particular reference to figures 12A, 
12B and 13 . The same reference numerals are used 

throughout to designate the same components . 

Figures 12A and 12B are top views of the bottom 
rollers of the tensioning, support and imaging section 30 
and the formers 44 and 50, being a view of only a portion 
thereof, in plan, illustrating positions of the belt sets 
involved, in order to assist with the explanation of the 
arrangement of the belt sets. For clarity, figure 12A 
illustrates top belt sets, but not bottom belt sets and 
figure 12E illustrates a bottom belt set but not top belt 
sets . 

Throughout the material samples traverse of the 
tensioning, support and imaging section, it is supported 
between upper and lower belts. The top belts comprise a 
rear top belt set 60 and a front top belt set 61. All 
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belts which are associated with any of the three roller 
sets described in relation to figure 7 comprise a 
plurality of webbing elements which are interleaved, so 
that they can move relative to each other. A belt 
5 comprised of a single integral webbing would prevent 
motion of the arrangement. The top belt sets, bottom 
belt set and the belts 56, 55 and 41, 42, comprise a 
plurality of separated webbing elements. For example, 
front top belt sets 61 comprises 25 separate webbing 

10 elements, as best illustrated in figure 13. Note that 
any number of webbing elements may be provided, depending 
upon the length of the rollers and required separation 
between the webbing elements. 

As well as the belts 56, 55, 41, 42, illustrated in 

15 figure 7, the arrangement also comprises a front top belt 
set 61 and a rear top belt 60 {figure 12A) , and a further 
bottom belt set 63 (figure 12B) . The bottom belt set 63 
passes around rollers 40a, 46 and 52 and over formers 44 
and 50. All webbing elements of the belts are 

20 interleaved to enable motion of the belts, as will be 
appreciated by the skilled person. Rollers 64, 65, 67, 
68, 69 are illustrated in figure 7 for carrying the top 
belts 61, 60. 

In operation, as the material sample enters the 
25 tensioning, support and imaging sections 30, between 
rollers 4 0a and 40b, it is contacted by the front top 
belt set 61 and the leading edge of the bottom belt 60. 
The material is thus maintained supported between the 
front top belt set 61 and the bottom belt 63 as it passes 
30 over the first former 44. The rear top belt set 60 is 
contacted at roller 46, so that at that roller both the 
rear and front belt sets, and the lower belt are still in 
contact with the material. At further former 50, the 
material is still in contact with the rear top belt set 
35 60 and the bottom belt set 63. As it leaves the 
tensioning, support and imaging section 30, the material 
is supported by belts 55 and 56. The material sample is 
thus totally support throughout its traverse of the 
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tensioning, support and imaging section 30. 

As is clear from figure 9, 10 and 10A, the belt 
webbing elements are arranged to run through slots 70, 
71 , 72, 73, 74, 75, 76 in the respective rollers. 

One problem with the belt arrangement of this 
embodiment, is that because the material sample is always 
sandwiched between two belt sets, it is not possible to 
obtain a single image of a full width of the material at 
any one point in the traverse through the 
tensioning/support and imaging section. 

To overcome this problem, the sample is imaged at 
two separate areas through the traverse, the first area 
being provided by top surfaces 4 5 on the first former 44 
and the second area being provided by top surfaces 51 of 
the further former 50. A plurality of imaging windows 
75, 76 are defined for the imaging areas. This is most 
clearly shown in figures 12 and 13. It can be seen that 
the window 75, 76 are staggered with respect to each 
other. The portion of the material which did not get 
imaged as it passed over the first former 44, therefore, 
will get imaged as it passes over the further former 50, 
through imaging windows 75. The processing means 23 then 
operates, when it is building up the image of the 
material sample, to interleave together the staggered 
views of the image. Two CCD's, 34a, 34b are provided to 
image the two imaging areas. 

The roller sets 46, 47 and 52, 53 tension the 
material sample in a direction transverse to the 
longitudinal axes 49 and 56 of the formers 44 and 50. 
Where the material is leather hide and is fed through the 
section 30 in a direction transverse to the direction of 
the beasts backbone in its lifetime, this tensioning 
direction will open the majority of defects on the hide 
for imaging. It will not affect to as great a degree 
scars and defects which extend in other directions, and 
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particularly will not substantially affect scars and 
defects which extend in the same direction as this 
tensioning direction. To address this problem, means are 
also provided in this embodiment to tension the material 
5 in a direction which is substantially at right angles to 
the tensioning direction provided by the roller 
arrangements 47, 46, 52, 53. 

Frames 80A, 80B supports first 81 and second 82 
lateral tension bars. Figure 11 shows a bottom view of a 

10 portion of lateral tension bar 82. 

As well as the sections 51 and 45 of each former 
which provide surfaces for supporting the material in 
imaging areas, there are also provided a plurality of 
depressions, as shown in figure 10, reference numeral 63. 

15 As best shown in figure 10, lateral tension bar 82 
comprises a plurality of convex projections 84 which are 
positioned and arranged to be able to fit into the 
depressions 83 in the former 56. The lateral tension bar 
81 and former 44 have a similar arrangement. 

20 The frame 80 is mounted on mounts 85, 86 which can 

be raised and lowered to raise and lower the lateral 
tension bars 81, 82 away from and towards the respective 
formers 44, 50. In the lowered position (see figure 10) 
the projections 84 extend into the depressions 83 and 

25 force portions of the material sample 28 (figure 9) into 
the. depressions 83. Note that the upper belt 60 is also 
forced into the depressions. This results in the 
application of tension to the portions of material 28 
extending across the surfaces 51, the tension being in a 

30 direction substantially parallel to the longitudinal axis 
56 of the former 50. A similar arrangement and operation 
applies to former 44 and tension bar 81. This applied 
"lateral" tension is able to increase the visibility of 
scars and defects which do not extend in the usual 

35 direction . 

In figure 10 the tension bar 82 is shown in raised 
(right hand side of figure) and lowered positions. 

The tension bar 82 (the same arrangement applies to 
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tension bar 81) has a plurality of slots 87 which extend 
through the bar 82 and are coincident with imaging 
windows 76 . 

The CCD's 34a and 34b are mounted to the frames 80A, 
80B so that they are raised and lowered with the bars 81, 
82, in order to maintain a consistent distance between 
the bars (which rest on the surface of the material 
sample) and the CCD's 34a, 34b, in order to maintain 
focus . 

Materials such as leather hide may vary quite 
significantly in thickness, even over the extent of a 
single material sample. This creates a problem for an 
imaging means which must focus precisely on the surface 
of an area being imaged. If the surface profile is 
changing, the height of the area to be focused on 
relative to the imaging device will continually change. 
This embodiment of the invention addres ses this problem. 

Referring to figure 7, formers 50 and 44 are 
resiliently mounted on mounts 90, 91, respectively. The 
arrangement is such that the formers 50 and 4 9 can move 
upwards or downwards, although they are urged in an 
upward direction. The tension bar, however, in operation 
prevents the formers 44, 50 from moving upwards. Where 
the material of the sample increases in thickness, 
therefore, formers 49, 50 are forced downwards. The top 
surface of the material, however, maintains its distance 
from the CCD's 34a, 34b, as dictated by the tension bars 
81, 82. The linkage arrangement 94 connects the rollers 
46, 4 0a, 52 with the formers 4 9 and 50. 

A slot 95 in central mounts 93 allows vertical 
motion of the linkage arrangement 94. 

Pivotable mirrors 100, 101, 102, 103 are provided to 
adjust the position of the imaging area for both formers 
49 and 50. Sensitivity of adjustment is increased, by the 
positioning of mirrors 101 and 102 relatively close to 
the formers 49 and 50. Light sources 35A, 35B provide a 
source cf light, incident on mirrors 103, 104. 

As with the embodiment of figures 1 and 2, it is 
impcrtan: that the background colour of the support (the 
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former) in the imaging area provides sufficient contrast 
to the colour of the material sample to enable the 
imaging and processing system to detect the boarders of 
the sample. In this embodiment, each of the four sides 
5 of each of the formers 44 and 50 , is of a different 
colour. The colour sensor detects the colour of the hide 
as it approaches the support, tension and imaging section 
30, and control means operates a motor to rotate the 
formers 44 and 50 to present as an imaging surface the 
10 surface of the colour which provides the most contrast. 

Note that this device is not intended to be used 
with "raw" hide, which has not been coloured. Raw hide 
would have a number of markings and blemishes on it which 
would not be defects, but merely variations in colour of 
15 the hide. The system is intended to be used with hide 
which has undergone some preliminary treatment steps, in 
particular with hide that has been dyed or at least with 
hide which is at the "wet blue" stage. 

An alternative method of detecting and verifying 
20 defects in the hide will now be described with reference 
to figures 14 through 17. Rather than breaking the hide 
image down to discrete areas of 10 4 pixels, this 
alternative embodiment examines the area of the hide to 
determine and verify "edges" of defects. Some work has 
25 been done on statistical analysis of edges in images, but 
the present invention adds to it significantly in order 
to provide for accurate detection and verification of 
defects. 

The input for the system of this embodiment is the 
30 digital image of a leather hide, the output is a defect 
map which carries the location and severity of each 
defect . 

Scars and mites usually create intrusions and 
extrusions on a leather surface. These intrusions -and 
35 extrusions on the surface form "hills" and "valleys" of 
different height and depth. Consequently, these hills 
and valleys create small patches that have various 
reflecting angles with respect to light sources and 
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camera, and appear darker and/or brighter than the 
otherwise homogeneous region. 

A leather surface usually is a surface with certain 
textures. The defects can vary in many ways, such as the 
severity which affects the composition of grey level 
values in the area of consideration, the area and shape 
of the defect, etc., as mentioned above. 

The texture in a hide can vary in many ways too. 
The degree and type of texture can vary from region to 
region in the same hide. These are the physical 

characteristics of the texture itself. Same level and 
type of texture can also appear differently in an image 
because of the external conditions that are affected by 
illumination, local thickness variation, reflective 
angle, surface finish etc. 

Surface finish is a very important factor. High 
reflective surface such as high shine leather hides are 
much more difficult to analyse because they are easily 
affected by the external factors (such as illumination, 
etc) . Dark colour adds difficulty to the problem, 
because with a dark colour, the light intensity of the 
light source needs to be strong and it makes the high 
reflective surface behave more unpredictable. 

Because of these facts, a defect may not appear to 
be a defect in a region that is heavily textured or 
having heavy noise. Or a severe defect may appear to be 
less serious in some region. Also, natural hide texture 
or noise can be falsely detect as defects due to the same 
reason . Therefore , misdetection and false detection 
happen often. 

Due to the size of the hide (2x3 square meters) , 
there are basically two problems: 

1. the same type of defects appear differently in 

different regions of the hide; 
2 . the amount of information to be processed is 

large. (about 50-70 MB/hide) . 
In this embodiment we examine the defects by 
examining the boundaries or edges of the defects. Edaes 
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in a grey level image are discontinuities in image 
intensity profiles. Usually, an edge can be regarded as 
the boundary between two regions with relatively distinct 
grey level properties. ■■ Edges may represent boundaries 
of objects, marks, shadows and shading. 

The edge model we consider is shown in Fig 14 . 
This model is a generalized edge which consists a step 
edge and noise and/or textures. The cross-sections of 
the edge are taken in the direction of d max , for which the 
slope measured is maximum (note that x,y are the 
coordinates of the particular point on the image) . 

To examine an edge, and determine if a candidate 
edge is really resulted from the defect that is 
surrounded by it, we need to consider the following: 

• the definition and characteristics of defect; 

• the definition and characteristics of normal 
surface ; 

• the external conditions such as illumination, 
local thickness variation, reflective angle, 
surface finish and textures. 

Normally, some of the above considerations are taken 
into account in the process of generating edges. 
However, we propose the idea of defect examination by 
examining their edges and this work is the first on 
examining candidate edges by considering these 
situations. The benefits of using this method can be 
surmised as : 

• saving computational time considerably, thus 
making this method more suitable for real 
industrial inspection tasks in production 
environment ; 

• providing more accurate description of the 
characteristics for both normal region and 
defects that are separated by the edges being 
examined, thus making accurate decision-making 
possible ; 

• giving accurate information on both the position 
and the severity of a defect; 
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• making it easier to adapt this method for other 
applications (not only leather surface 
inspection) . 

Intensity changes in a grey level image take place 
at many spatial scales. It is realized that fine 

intensity changes are detected by small scale operator 
and coarse intensity change information is collected by 
large scale operator. Edges in the original image that 
can be detected at small scales may disappear at coarser 
scales, and spurious edges can occur at a coarse scale. 
In order to detect edges occurring at a variety of 
spatial scales, multi-scale edge detection method has 
been used. Intensity changes at different scales can be 
obtained by applying edge operators of different sizes. 
The final results are obtained by combining the edge 
information recovered at each scale. This is how edge 
detection is normally applied. This method is 

computationally expensive, because of the following 
reasons: 

• smooth operation which is usually the most time- 
consuming operation needs to be applied on to an 
image more than once; each scale operator has to 
be applied once, for instance, if operations of 
scales 0], 02,..., a n neec ^ to k> e applied, we will 
have to do n such operat ions; and the greater 
the value of o e more time consuming the 
computation becomes; 

• combining of edge information obtained at each 
scale is highly complex. 

At the same time, undesirable intensity changes due 
to noise and/or natural textures may also be picked up in 
either small or large scales. 

It has also been suggested that an image be 
segmented into regions that have relatively homogeneous 
intensity changes, and then edge operators are applied to 
the regions accordingly with proper scale parameters. 
However, part of the problem with this method is also its 
large computation demand. Gaussian smoothing can be 
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done separately in rows and columns on the whole image if 
it is to be smoothed with a single scale, thus the 
computation can be reduced. The separability of 

Gaussian can reduce a 2D convolution into a pair of two, 
successive ID convolutions. Therefore, a computation 

complexity of 0(M*) is reduced to O(M). However, if the 
whole image is divided into regions of different scales, 
this time-saving characteristic cannot be exploited 
efficiently. Also, if an image is smoothed with 

different scales in different regions, there is 
discontinuity between the edges thus detected. If the 

smoothing kernel is large the accuracy of the edge 
location suffers. 

The method developed for the present invention uses 
the relatively time-consuming Gaussian smoothing 
operation onlv once to generate candidate edges of 
defects. Then the candidate edges are examined with a 
two stage method. 

The first stage of the method of the present 
invention includes the examination of each individual 
point (pixel) on an edge, determines whether or not that 
point (pixel) should be included on that particular edge. 
The examination scheme includes the comparison of three 
entities: the point a being examined (Fig 15) an inner 
area that immediately surrounds the point and an outer 
area- that is outside of the inner area. We consider the 
statistics of these three entities and have worked out 
the relationship between the given definition of defect 
and the statistics of these three entities. Then 
decision can be easily made. 

The second stage is the consideration of an entire 
edge as a single entity as shown in Fig 15, and then 
examines whether or not this edge is caused by noise or 
texture or real defect, and then makes the decision of 
keeping it or removing it. The examination scheme is 
similar to the examination of an edge point described 
above. We still consider three entities. Here, we 

consider the entire edge as a single entity instead of a 
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point on the edge. The length of the edge is also taken 
into consideration in this scheme. Since the areas we 
use are the areas next to the edge and have constant 
distant to the edge, the statistics from them give more 
accurate description of the edge and its neighbourhood. 
Also, the relationship between the given definition of 
defect and the statistics of these three entities is 
given, so that examination of defect is achieved. 

An example of defect examination is shown in Fig 17 . 
Verification algorithm applied to a leather surface 
image with a heavy texture background on the left and 
smooth texture background on the right. (a) original 
image, (b) edge detector applied with a = 1.5, (c) after 
examination algorithm applied to (b) . 

The following is a flow chart of the defect 
examination process applied in this embodiment, detailing 
the algorithms involved. 

Flow chart of defect detection and examination. 
1. Using Canny edge operator to detect the possible 
def ect edges. (John Canny, "A Computational 

Approach to Edge Detection, " IEEE Transactions 
on Pattern Analysis and Machine Intelligence , 
Vol. PAMI-8, No. 6, November 1986, pp 679-697.) 
The algorithm of this edge operator can be 
briefly described as the following: 

(a) Smooth the image with a 2D Gaussian 
function. The mathematical form of a 2D 
Gaussian is: 

2 it a 2 2a z 

To smooth an image I(x,y), we can simply 
apply a mathematical convolution between these 
two : 

G(x,y) *I (x,y) . 
The resultant image will be a smoothed 
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one. We can control the degree of this 
smooth operation by choosing different a's 
in the 2D Gaussian. Consequently, the 
size of the Gaussian mask changes. The 
5 size of a Gaussian mask is m x m is 

determined by the following equation: 

m = (integer) (3 x o + 0.5) x 2) +1. 

For example, if o = 1.5, then m will be 
11, which means we will apply a window of 

10 size 11 x 11 onto the image and smooth the 

image accordingly. Therefore, the 

'block 1 associated with each pixel has 11 
x 11 = 121 pixels. In this application, 
the value of a is a constant, which 

15 indicates that the size of ' block* is a 

constant. This feature takes advantage 

the fact that Gaussian smoothing can be 
done separately in rows and columns on the 
whole image if it is to be smoothed with a 

20 single a. The separability of Gaussian 

can reduce a 2D convolution into a pair of 
two, successive ID convolutions. 
Therefore, a computation complexity of 
0(M*) is reduced to O (M) . 

25 (b) The computation of first derivative is 

carried out on the smoothed image . The 
edges of candidate defects are then 
detected. (described by John Canny, "A 

Computational Approach to Edge Detection, " 

30 IEEE Transactions on Pattern Analysis and 

Machine Intelligence, Vol. PAMI-8, No. 6, 
November 1986, pp 679-697.) 



35 



2. First stage of edge examination by considering 
each edge pixel and its neighbourhood (Fig 15) . 
Before using the hysteresis suggested in (John 
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Canny, "A Computational Approach tc Edge 
Detection, " IEEE Transactions on Pattern 
Analysis and Machine Intelligence, Vol. PAMI-6, 
No. 6, November 1986, pp 679-697), we examine 
5 edge pixels. Normally, whether or net an edge 

pixel is significant (in our application, 
whether or not an edge pixel represents a pixel 
on the edge of a defect) is determined by 
examining only the strength of the edge point 

10 this pixel represents. This approach appears 

to have problems in dealing with images having 
textures and/or noise, because the nature 
textures are not defects that have tc be 
identified. Nature textures can have edges that 

15 have high strengths similar tc the defects. 

This step of examination is designed for edge 
point verification . 

To each edge point (pixel in the image) , we 
consider a neighbourhood (block) in the fashion 

20 that the pixel being considered is lecateu in 

the middle of the block. For instance, if 

pixel a in Fig 15 is being examined, and the 
neighbourhood to be considered is w x w, in this 
case, w = S. If we denote the edge strength of 

25 point a is a real defect edge point if 

£, > c 

otherwise, this point does not represent a 
defect edge point. S in the above expression 
(1) is the standard deviation of the grey levels 
of the pixels in the block. or can be chosen as 
30 0.1, 0.2, 0.3, etc. and Z a can be found from 

standard normal distribution tables. c is a 

constant representing the given threshold which 
can be chosen according to the nature of leather 
hides . 

35 2 . use cf hysteresis method to generate edges by 
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using only the pixels that have passed ess: (1) . 

4. Trace the contour of each edge thus detected. 

5 . Second stage of edge examination by verif ving 
each individual edge as a whole entity. We 
need to generate an area that surrounds the edge 
and calculate the joint distribution. An 
example of the block that surrounds a candidate 
edge is shown in Fig 16 . We denote the edge 

strength of an edge as E. E is the average of 
the edge strength of each edge point on the 
edge, and can be calculated using: 




where £*; is the edge strength cf the ith pixel 
on the edge . 

We have developed the following expression to 
test an edge to see whether it is defect edge or 
just an edge due to nature leather textures or 
noise . 



m 



2m - 4 



(21 



where Vjq> is the sample variance of the grey 
levels of the pixels located in the block, 2m is 
the number of the pixels located in the block. 
The constant c or and Za can be chosen in a 
similar way described for test (1) . 
If an edge with edge strength E passes the test 
(1), then this edge is an edge of defect, and 
further process is required. Otherwise it is 
an edge cf texture of noise, and it should be 
removed . 

The system of the present invention may be useful 
with other types cf materials, not just leather. 

Variations and/cr modifications may be made in the 
invention as described in the specific embodiments 
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without departing from the spirit or scope of the 
invention as described and defined in the following 
statements of claims. 



0 
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THE CLAIMS DEFINING THE INVENTION ARE AS FOLLOWS : 

1. A visual inspection system for non-rigid 
materials, comprising a mounting means for mounting a 
sample of the material, tensioning means for tensioning 

5 at least an area of the sample, an imaging means for 
obtaining an image of the area of the sample under 
tension and processing means for processing the image to 
provide information on any defects which may exist. 

2. A visual inspection system in accordance with 
10 claim 1, comprising a former over which the material 

sample is tensioned to enable the imaging means to better 

perceive any defects in the material. 

3 . A visual inspection system in accordance with 

claims 1 or 2, further comprising a light source for 
15 illuminating the area of the sample being imaged, the 

relative positions of the light source, imaging means and 

sample being arranged so that the imaging means perceives 

defect areas on the sample as having a different grey 

level than undefected areas. 
20 4 . A visual inspection system in accordance with 

claim 3, the light source providing a source cf variable 

light intensity and incorporating focusing means for 

illuminating a strip of the sample. 

5. A visual inspection system in accordance with 
25 claim 4, the light source being arranged to illuminate a 

strip of the "hide. 

6. A visual inspection system in accordance with 
any preceding claim, further comprising a drive and 
support means for supporting and moving the material 

30 sample relative to the imaging means whereby to tension 
and obtain images of a plurality of areas of the sample. 

7. A visual inspection system in accordance with 
claim 6, the drive and support means including a 
plurality of drive and support belts and wherein the 

35 arrangement of the plurality of belts is such that the 
material sample is supported throughout its movement 
relative to the imaging means. 

8. A visual inspection system in accordance with 
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claim 7, wherein a plurality of imaging windows are 
provided coincident, with gaps in the belts the imaging 
means being arranged to obtain images of the areas of 
material sample passing by the imaging windows, whereby 
to obtain images of plurality of areas of the sample. 

9. A visual inspection system in accordance with 
any one of claims 1 to 8 , the tensioning means being 
arranged to apply tension to the area of the sample in a 
first direction and in a second, different, direction. 

10. A visual inspection system in accordance 
with claim 9, wherein the second different direction is 
perpendicular to the first direction. 

11. A visual inspection system in accordance 
with any one of claims 2 to 8, the former being 
substantially elongate in shape and the tensioning means 
including means for applying tension in a direction 
substantially at right angles to a longitudinal axis of 
the former, whereby to tension the material sample over 
the former . 

12. A visual inspection system in accordance 
with claim 11, wherein the tensioning means further 
comprises means for tensioning the material in a 
direction parallel with the longitudinal axis of the 
former . 

13. A visual inspection system in accordance 
with claim 12, wherein a first surface of the former, 
over which the material sample is to pass, is formed by a 
plurality of at least partially convex or flat areas 
separated by depressions in the surface, and the 
tensioning means includes means for forcing portions of 
the material sample into the depressions as the material 
sample is passed over the former, whereby to tension the 
material sample over the convex or flat areas in a 
direction substantially parallel to the longitudinal axis 
of the former. 

14. A visual inspection system in accordance 

with any one of claims 2 to 13, wherein the former and 
imaging means are mounted for movement relative to each 
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other, and compensation means are provided for 
automatically adjusting the relative positions of the 
former and imaging means in response to variations in 
thickness of the area of the material sample being 
tensioned, whereby to maintain a substantially fixed 
distance between the imaging means and the surface of the 
area of the sample being imaged. 

15. A visual inspection system in accordance 
with any preceding claim, wherein the imaging means 
comprises a charged coupled device (CCD) and a focusing 
means for focusing an image of the area being imaged onto 
the CCD. 

16. A visual inspection system in accordance 
with claim 15 , wherein the focussing means includes a 
pivot able mirror mounted close to the imaging area, 
whereby to result in increased focusing control. 

17. A visual inspection system in accordance 
with any preceding claim, the processing means being 
arranged to statistically analyse grey levels of pixels 
imaged by the imaging device, by applying a normal 
distribution on either side of a median grey level which 
is defined as undefected leather, and determining an 
extreme or extremes of the normal distribution as 
defining defected areas of leather. 

18. A visual inspection system in accordance 
with, claim 17, the processing means being arranged to 
produce a contour map showing the extent and location of 
defects in a material sample. 

19. A visual inspection system in accordance 
with claim 18, the processing means further being 
arranged to scan the contour map with a template of 
predetermined area in order to determine the area of 
material which is useful for the manufacture of product. 

20 A visual inspection system in accordance with 
any one of claims 17 to 19, the processing means being 
arranged to analyse the image by analysing "cells" of the 
image separately, each cell forming a predetermined 
portion of the entire image. 
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21. A visual inspection system in accordance 
with any one claims 1 to 16, the processing means being 
arrange to apply an edge detection algorithm to determine 
edges of defects in the leather hide. 

22. A visual inspection system in accordance 
with claim 21, the edge detection process comprising two 
stages, the first stage including an examination of each 
pixel in an edge and its surrounding area, and the second 
stage including an examination of the pixels on an edge 
and their surrounding area. 

23 . The present invention further provides a 
method of visually inspecting materials, comprising 
mounting a sample of the material, applying tension to at 
least an area of the material, obtaining an image cf the 
area cf material from an imaging device and processing 
the image to provide information on any defects which may 
exist in the material. 

24 . A method of processing an image of a 
non-rigid material sample, comprising the steps of 
applying an edge detection algorithm to determine edges 
of defects in the material. 

25 . A method in accordance with claim 24 , the 

edge detection process comprising a step including an 
examination of each pixel in an edge and its surrounding 
area, and a step including an examination of the pixels 
on an edge and their surrounding area . 
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